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Abstract 

The complex Langevin method is a leading candidate for solving the so- 
called sign problem occurring in various physical situations. Its most vex- 
ing problem is that in some cases it produces 'convergence to the wrong 
limit'. In the first part of the paper we go through the formal justification 
of the method, identify points at which it may fail and identify a neces- 
sary and sufficient criterion for correctness. This criterion would, however, 
require checking infinitely many identities, and therefore is somewhat aca- 
demic. We propose instead a truncation to the check of a few identities; 
this still gives a necessary criterion, but a priori it is not clear whether it 
remains sufficient. In the second part we carry out a detailed study of two 
toy models: first we identify the reasons why in some cases the method 
fails, second we test the efficiency of the truncated criterion and find that 
it works perfectly at least in the toy models studied. 
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1 Introduction 



The sign problems arising in simulations of various systems, in particular in QCD 
with finite chemical potential [1], are in principle solved by using the complex 
Langevin equation (CLE). This method, after being proposed in the early 1980s 
by Klauder [2] and Parisi [3], enjoyed a certain limited popularity (see for in- 
stance |11[5]) and has in more recent years been revived with some success [6HT1]. 
Unfortunately already in the beginning problems were encountered. The first 
problem, instability of the simulations (runaways) can be dealt with by introduc- 
ing an adaptive step size, as shown in [H]. More vexing is the second problem: 
convergence to a wrong limit [IStiTS] . It is this problem which we wish to address 
in this paper. 

A formal argument for correctness of the CLE was presented in a previous 
paper [19]. It proceeded by comparing two time evolutions: the first one of a 
complex measure not allowing a probabilistic interpretation - the origin of the 
sign problem - , the other one of a positive measure on a complexified space, 
allowing a probabilistic interpretation and hence suitable for simulation. The 
main point was that, ignoring certain subtleties, these two time evolutions led to 
identical evolutions for the expectation values of holomorphic observables. This 
implied of course also that the long-time limits (assuming their existence) agreed, 
corresponding to the desired equilibrium expectation values. 

In [19] we already identified some difficulties with those formal arguments. 
Some of them were of a slightly academic nature, namely the mathematically 
sticky problem of the existence of those evolutions and their convergence prop- 
erties. Taking a pragmatic attitude, these problems are answered by performing 
simulations; in a large set of examples the answer is positive. The remaining 
problem is much more insidiuous: it may (and sometimes it does) happen that 
the results of a simulation are well converged and look perfectly fine, but turn out 
to be wrong when compared with known results. Of course in most interesting 
cases the results are not known and one would like to have a test to decide if one 
should trust the outcome of a simulation or not. 

To deal with the disease of 'convergence to the wrong limit' it helps to have 
a deeper understanding of its causes - the etiology - before developing ways to 
diagnose it. The possible causes of the failure of the formal arguments are: in- 
sufficient falloff of the probability distribution in the imaginary directions and 
too strong growth of the (time-evolved) observables in the imaginary directions. 
They can invalidate the integrations by parts that are necessary to show agree- 
ment of the two time evolutions mentioned above. Section [2] revisits the formal 
argument and deduces a crucial identity (depending on the observable chosen) 
that has to be fulfilled if the two time evolutions are to agree. 

Section [3] considers the long-time limits of the two time evolutions. Our set of 
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identities (one for each observable) leads in the long time limit to a set of simpler 
ones which turn out to be closely related to the Schwinger-Dyson equations. We 
show that in principle the complete set of these identities, together with a certain 
bound, is necessary and sufficient to establish correctness, provided some mild 
technical conditions are fulfilled. For practical purposes, however, the infinite set 
of identities has to be truncated to a finite (actually small) set; a proof of their 
sufficiency is thus no longer possible. 

We then study these issues in detail in two toy models. The first one is a one- 
link version of lattice U(l) gauge theory, already studied in [9|[T9]: the second one, 
which was first studied by Guralnik and Pehlevan [20] , is a polynomial model with 
purely imaginary action, which is a toy version of the real time Feynman path 
integral. In this investigation we use noise both in the real and the imaginary 
directions, even though in principle real noise would be sufficient. The reason for 
this is twofold: it allows to study how and why the formal arguments can fail, 
and it gives us the possibility to approach the problem also in the dual way by 
solving the Fokker-Planck equation. 

In Section IV we study the identity necessary for the agreement of the two 
time evolutions for the U(l) one-link model. In order to be able to do this 
with sufficient precision, we introduce a device that at first seems rather ad 
hoc: we introduce a periodic cutoff for the imaginary part of the field. But we 
can take advantage of the fact that a positive measure on the complexification 
of the original field space, required only to produce the right expectations for 
holomorphic observables, is not unique, so it is conceivable that a measure with 
cutoff gives correct results. With a cutoff we can compute the time evolution 
of the probability measure with high precision using the Fokker-Planck equation 
(FPE). The time evolution of the observables (averaged over the noise), is also 
needed; the way we define it here it does not depend on the cutoff. Of course 
the cutoff invalidates the formal argument, and as expected, we find that the two 
evolutions in general do not agree. But surprisingly it turns out that the cutoff 
can be tuned to a value that restores agreement. 

But how can the formal argument fail when there is no cutoff? This is ex- 
plained by looking at the growth of the (noise averaged) observables in imaginary 
direction, evolved for a finite amount of time. It turns out that these averages 
grow like an exponential of an exponential, a growth that cannot be compen- 
sated by the decay of the probabihty measure; so the formal argument becomes 
inapplicable. 

In Section V we investigate for both toy models the falloff of the equilibrium 
distribution in imaginary direction; again it is found that in the presence of com- 
plex noise the falloff is insufficient for the derivation of the SDK identities. This 
corroborates the indications presented in [T^]. On the other hand, for only real 
noise the distributions show much stronger falloff (actually they are concentrated 
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on a line in the U(l) one-link model), which is sufficient for the derivation of the 
SDE identities. 

Finally in Section VI we use a truncated form of our SDE criterion as a test 
of correctness of the equilibrium measures in both our toy models; it turns out 
that the test is surprisingly strong. To put it in terms of medical statistics: the 
test has perfect specificity (100%), i.e. when the simulation is correct, it is always 
fulffiled; this is a general mathematical fact. But the pleasant surprise is its 
very strong sensitivity, meaning that in the cases studied, when it is fulfilled, the 
results, as far as checked, are correct. 

Here again we introduce a periodic cutoff for the imaginary part of the field 
variable. As in the finite time situation this can in general not be expected to 
work, because it destroys the formal argument for correctness, but again it turns 
out that in the two toy models studied here, the cutoff can be tuned to produce 
correct results. Requesting fulfillment of a few of the identities mentioned above 
is then used as a test for correctness: surprisingly we find not only that this test 
can be fulfilled by tuning the cutoff, but that in this case we obtain the correct 
expectation values. The same situation arises for real noise: the simulations pass 
the test and produce the right values. However, in lattice models the situation is 
not so simple and just suppressing imaginary noise is not always sufficient. This 
has already been found in the XY model [H]; in a separate paper [21] that model 
will be analyzed further from the point of view developed in this article. 

Finally in Sec. [7| we draw some conclusions and present an outlook on work 
in progress. 

2 The formal arguments revisited 

We briefly go through the arguments presented in [19], concentrating on models 
in which the fields take values in fiat manifolds A4r = or A^^ = T"', where T"' 
is the n dimensional torus (S^)"^ with coordinates (xi, . . . , x„). 

The complex measure exp{—S)dx, with S a holomorphic function on a real 
manifold Ai, is replaced by a positive measure Pdxdy on the complexification 
M.C of Ai, which is the equilibrium measure of the complex Langevin process 
on Aic'i the hope is that expectation values of entire holomorphic observables O 
agree with those obtained using the complex measure exp{—S)dx. 

The complex Langevin equation (CLE) on Aic is 



where dwR and dwi are independent Wiener processes, Nj > and Nr = Nj + 1. 





(1) 
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In the case Ni > we speak of complex noise. The drift is given by 

K^ = - ReVxS{x + iy), 

Ky = -lmV,S{x + iy). (2) 

By Ito calculus, if / is a twice differentiable function on A^^ and 

z{t) = x{t) + lyit) (3) 
is a solution of the complex Langevin equation ([1]), we have 

|(/(x(t),y(t))) = (L/(x(t),y(t))), (4) 

where L is the Langevin operator 

L = [NrV^ + K,] V, + [NiVy + Ky] Vy, (5) 

and (/) denotes the noise average of / corresponding to the stochastic process 
described by Eq. ([1]). In the standard way Eq. ([1]) leads to its dual Fokker-Planck 
equation (FPE) for the evolution of the probability density P{x, y; t), 

^^P{x,y;t) = L^P{x,y;t), (6) 

with 

= V, [NjiV, - K,] + Vy [NjVy - Ky] . (7) 

L'^ is the formal adjoint (transpose) of L with respect to the bilinear (not hermi- 
tian) pairing 

(P,/)= [ f{x,y)P{x,y)dxdy, (8) 



I.e., 

{P,Lf) = {L^P,f). (9) 

To understand the relations between the real and the complex measures one has 
to consider the evolution of a complex density p{x) on Ai under the following 
complex FPE 

^^p{x;t) = L^pix;t), (10) 

where now the complex Fokker-Planck operator Lq is 

= V. [V. + (V.5(x))] . (11) 

We will also use a slight generalization: For any yQ E Ai we consider the complex 
Fokker-Planck operator L^^ given by 



^,=V4V, + {V.,S{x + tyo))]. (12) 
5 



is the formal adjoint of 

Lyo = [Vx- - (V,^(x + tyo))] V,. (13) 

The complex density 

p(x; oo) oc exp [— S'(x)] (14) 

is a stationary solution of Eq. ( ITOj) . which is expected to be unique. Numerical 
studies (where feasible) of Eq. ( fTOj) confirm this; in fact the convergence to the 
limit Eq. ( iMl) seems to be exponentially fast. 

We have to make a few technical remarks about the space of observables we 
choose: all observables have to be entire holomorphic functions; we will further- 
more require that their restrictions to the real submanifold Air span a large 
enough space V: 

(1) if JUr = T", V should be a dense subset of C{J^r), the set of all continuous 
functions on JH equipped with the norm \ \0\ \ = sup^ |(9(x)|; a good choice is the 
space of finite linear combinations of exponentials. 

(2) if Air = and the action 5* has a real part that grows at least like |x| 
as — >■ oo, the functions in O e D should be bounded polynomially and dense 
in the Banach space defined by the norm ||C|| = sup3,exp(— |x|)|C(x)|; a natural 
choice for V is the space of polynomials. 

(3) if = I^" and the action is purely imaginary, one has to find a subman- 
ifold Ai'j. C Aic which is a suitable deformation of Air into the complex domain, 
such that the integral of exp(— 5) converges and Ai'^. can still be parameterized 
by X G M". The conditions on the obervables, expressed in this parameteriza- 
tion are then as in (2). In a slight abuse of language, we still refer to A^^ as 
the 'real submanifold'. Again polynomials are a natural choice for the space of 
observables. 



We set 



_ J 0{x + iy)P{x,y]t)dxdy ^^^^ 
J P{x,y;t)dxdy 



and 



/ 0{x)p{x; t)dx 
f p{x] t)dx 

What one would like to show is that 



(0)P(,) = (17) 

if the initial conditions agree, 

(O)p(o) = (O)p(o), (18) 
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which is assured provided 

P(x, y;0) = p(x; 0)5(1/ -yo). (19) 

One expects that in the hmit t — oo the dependence on the initial condition 
disappears by ergodicityQ 

To estabhsh a connection between the 'expectation values' with respect to 
p and P for a suitable class of observables, one moves the time evolution from 
the densities to the observables and makes use of the Cauchy-Riemann (CR) 
equations. Formally, i.e. without worrying about boundary terms and existence 
questions, this works as follows: first we use the fact that we want to apply the 
complex operators Ly^ only to functions that have analytic continuations to all 
of M.C- On those analytic continuations we may act with the Langevin operator 

L=[V-.- {V.S{z))] v., (20) 

whose action on holomorphic functions agrees with that of L, since on such 
functions V^^ = and A^. = —^y so that the difference L — L vanishes. 

We now use L to evolve the observables according to the equation 

dtO{z;t) = LO{z;t) (t > 0) (21) 

with the initial condition 0{z; 0) = 0{z), which is formally solved by 

0{z;t) =exp[tL]0{z). (22) 

In Eqs. (pT| [221). because of the CR equations, the tilde may be dropped, and we 
will do so now. So we also have 

0{z;t) =exp[tL]0{z). (23) 

In [19] it was shown that 0{z; t) is holomorphic if 0{z; 0) is. The evolution can 
therefore also be obtained equivalently by solving 

dtO{x + zyo;t) = Ly^O{x + zyo;t) (t > 0) (24) 

and subsequent analytic continuation. 

The crucial object to consider is, for < r < t, 

F{t,T) = J P{x,y;t-T)0{x + iy;T)dxdy, (25) 

which interpolates between the p and the P expectations: 

F(t,0) = (O)p(i), F{t,t) = {0),^t). (26) 

^In |13] dependence on initial conditions was found to be due to peculiar features of the 
classical flow pattern, leading to degenerate equilibrium distributions. 
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The first equality is obvious, while the second one can be seen as follows, using 
Eqs. (da [23]), 

F{t,t) = J P(x,?/;0) (e*^0) {x + iy]0)dxdy 
p{x]0) (e*^"C) {x]0)dx 



0{x; 0) (^e*^vj (x; 0)dx 

= {0)m^ (27) 

where it is only necessary to assume that integration by parts in x does not 
produce any boundary terms. 

The desired result Eq. f|T7|l would follow if F{t, r) were independent of r. To 
check this, we take the r derivative: 

^F(t, r)=- J (L^P(x, y; t - r)) 0(x + ty; T)dxdy 

+ j P{x,y;t - t)LO{x + iy;T)dxdy. (28) 

Integration by parts, if applicable without boundary term at infinity, then shows 
that the two terms cancel, hence ^F(t,r) = and thus proves Eq. (|T7I) . irre- 
spective of Nj. 

So here we have found a place where the formal argument may fail: if the 
decay of the product 

Pix,y;t-T)0{x + ty;T) (29) 
and its derivatives is insufficient for integration by parts without boundary terms. 
If fl28|) vanishes and furthermore 

lim(0),(t) = (0)p(oo), (30) 



with p(oo) given by Eq. fll4p . one can conclude that the expectation values of the 
Langevin process relax to the desired values. Eq. fl30|) requires that the spectrum 



of Ly^ lies in a half plane Re 2; < and is a nondegenerate eigenvalue. (Actually, 



convergence of P{x, y; t) is more than what is really needed, because the measure 
will only be tested against holomorphic observables.) 

The numerical evidence in practically all cases points to the existence of 
a unique stationary probability density P{x,y; 00). More detailed information 
about this will be given below. 

In pro] three questions were raised. The first one concerned the exponentiation 
of the operators L, L and their transposes, or in other words whether they are 
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generators of semigroups on some suitable space of functions. Even though we 
have not found a general mathematical answer to this question, numerics indicate 
that it is affirmative in all cases considered; for Ly^ in our first toy model a proof 
will be given in Sec. HI Likewise it is not known whether the spectra of L, Ly^ are 
contained in the left half plane and if is a nondegenerate eigenvalue, but the 
numerics again strongly indicate an affirmative answer. 

So the main remaining question concerns the integrations by parts without 
boundary terms, which underlie the shifting of the time evolution from the mea- 
sure to the observables and back; actually what is really needed is the ensuing r 
independence of F(t,r), defined in Eq. 

A crucial role for the correctness of CLE simulations is therefore played by 
the vanishing of ( 128|) . Whether this holds or not will be studied in detail for one 
of our toy models in Section El 



3 A criterion for correctness 

As explained in the previous section, r) has to be independent of r for all 
times t, i. e. 

^i^(t,r) = 0. (31) 

Below in Section IV it will be seen that for the U(l) one-link model the r deriva- 
tive is largest at r = 0. This motivates to try the superficially weaker condition 

= . (32) 

T=0 

We will see later that this condition is in fact still sufficient for correctness, modulo 
some technical conditions, if it holds for a sufficiently large set of observables. 

If we now look again at Eq. ( l28l) . we realize that for the equilibrium measure 
(always assuming it exists) L^P{x, y; oo) = and hence the first term on the 
right hand side vanishes. The criterion (132|) thus turns into 

Eo = j P{x, y, oo)LO{x + ly] 0)dxdy = {LO) = , (33) 

where we used the fact that on O L and L can be used interchangeably. This 
would of course also follow from the equilibrium condition L^P{x, y; oo) = on 
Aic, if the decay of P at large y is sufficient to allow integration by parts on Ai^ 
without boundary term. Eq. fl33|l is a fairly simple condition that is rather easy 
to check for a given observable. But it has to be satisfied for 'all' observables 
i.e. for a basis (in a suitable sense) of our chosen space V, so it represents really 
an infinite tower of identities. 



lim —F(t, t) 

t^oo dr 
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It may be worth noting that the collection of identities (133|) . applied to all 
observables, is closely related to the Schwinger- Dyson equations (SDE). We show 
this for the simple case of a scalar theory on a lattice with fields denoted by (pi : 
the SDEs are well-known to arise from the relation 

//#\ (34) 



d(t)i I \ d(j)i 

for 'any' function / of the fields (in most applications the observables are chosen 
to be exponentials exp(^^ 4>iji))- Our Langevin criterion (LO) on the other hand 

^^^^ 

It is quite obvious that Eq. (134|) implies Eq. ( 135|) : we only have to set in Eq. (l34|l 
/ = diO. The converse is also easy: we only have to find a set of observables Oj 
satisfying 

this involves just inversion of the (functional) Laplace operator, which is always 
possible here, because the only zero modes are constants. 

We proceed to show that in principle the identities for a sufficiently large 
(countably infinite) set of obervables are also sufficient to assure correctness, pro- 
vided a certain bound is satisfied. Let us now assume that we have, by whatever 
method, obtained a measure Q on Aic that allows integration of all O ^ V and 
furthermore satisfies a bound 

\{Q,0)\<C\\0\\, (37) 

where C is some constant and the norm is the one discussed in Section II (recall 
that this norm only involved the values of O on A^^). We claim that modulo 
certain technical conditions the fulfillment of Eq. f l33p for a basis of T>, 

{Q,LO) = J Q{x,y)LO{x + iy)dxdy = 0, (38) 

implies that the Q expectations are correct, i.e. 

{Q,0)=[Qix,y)Oix + iy)dxdy = ^[ 0{x)e-^^''^dx . (39) 

J ^ J Mr 

The argument uses the fact that the values of O on Ai^ already determine the 
values on Aic- So {Q, O) can be viewed as a linear functional on the space T) 
considered as functions on A^,., which is assumed to be dense in C{M..,). Because 
of the bound Eq. (137|) this functional has a unique extension to a linear functional 
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on all of C{Air)- By a standard theorem of analysis - the Riesz-Markov theorem 
(see for instance [22]) - this linear functional is therefore given by a complex 
measure aqdx on Ai, i.e. we can write 

{Q,0)= [ Oix)aQix)dx, (40) 

JMr 

where ctq is allowed to contain 6 functions. Since O was any observable, we may 
replace it by LO; we then have 

{Q,LO)= [ iLO)ix)aQix)dx = , (41) 

JMr 

which is equivalent to 

/ O{x)maQ){x)dx = 0, (42) 

JMr 

using only integration by parts on Air, which in general unproblematic. Since 
this holds for all O in the dense set V, we conclude 

L^aQ = 0. (43) 

To deduce from this that ag = exp{—S)/Z we only need that is a nondegenerate 
eigenvalue of L^, an assumption we had to make anyway in Section II. In concrete 
models this needs checking, of course. 

If, on the other hand, we find Eq 7^ for some observable O, this means 
that our simulation is not correct. Since by formal integration by parts on Aic 
the equilibrium condition L'^P{x, y; 00) = would imply Eq = 0, we can see 
only one possible reason for Eo 7^ 0, namely insufficient falloff of the equilibrium 
measure in imaginary direction. 

This whole discussion is a bit superficial, as far as the functional analysis 
is concerned, but it is not worth going into more detail here, since it is quite 
academic anyway. In practice it will be difficult to check the bound Eq. fl37|) 
(see however Section VI) and impossible to check the criterion for a full basis of 
observables; we are reduced to checking it for a few. So the sensitivity of the 
resulting test needs to be checked experimentally. 

It is well known that the SDE's have spurious, unphysical solutions (see for 
instance [23], [Z] or [21] )• This should be obvious from the fact that they are 
equivalent to a (functional) differential equation which requires at least some 
kind of boundary conditions for definiteness and also from the fact that they are 
recursive relation that can always be fulfilled by fixing the low moments/modes in 
an arbitrary way. So it has to be checked whether requiring the criterion Eq. fl33|) 
in fact selects the correct expectation values. The bound Eq. f p7|) will in general 
be sufficient for this. In Section E] we will see how this works in the U(l) one-link 
model. 



11 



4 Detailed study of Fit^r) for the U(l) one-link 
model 



4.1 Numerical study 

The U(l) one-link model was introduced in [9] and studied further in [19]. At 
lowest order in the hopping expansion it is defined by the action 

S = —(3 cos z — K cos{z — ifi) = —a cos(z — ic) , (44) 

with 

a= ^{(3 + Kef){(3 + ne-f'^ , (45) 

1 (46) 

leading to the drift 

= —Re S' = —asinx cosh.{y — c), (47) 

Ky = —ImS' = — acosxsinh(?/ — c). (48) 

It is easy to see by shifting an integration contour that no essential generality is 
lost if we set c = 0. So in the sequel we will make this choice. We will also set 
a = 1. 

A natural choice of a basis for the space of observables are the exponentials 
grfc2_ Here we study in detail the question whether the quantity F(r, t), see 
Eq. (1251) . is indeed independent of r, as required for correctness. We use both 
CLE and FPE for this analysis; since the former yields ambiguous results for 
k > 1 if Nj > 0, whereas the latter requires Nj > for stability (see below), we 
are forced to introduce a field cutoff in this analysis. We are aware of the fact 
that such a cutoff destroys the formal argument for correctness, but using the 
nonuniqueness of the positive measure on A^c there is still a chance to get correct 
results with such a measure; we will check whether it is possible by tuning the 
cutoff. 

We introduce the cutoff in the simplest possible way by imposing periodic 
boundary conditions in field space. In our U(l) one-link model we have periodic 
b.c. in the x direction by definition, so we only have to cut off the imaginary part; 
we denote the value of the cutoff by Y, such that —Y < y <Y. Periodizing the 
observable of course violates the Cauchy-Riemann (CR) equations at the 'seam', 
while the drift becomes discontinuous across the 'seam' making the interpretation 
of the FPE also difficult. But quite independent of those issues, if Eq. f ET]) holds 
the equality Eq. f[T7|) follows and thus the correctness of the CLE method is 
assured. 
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In any case we will see that our rather naive cutoff procedure seems to be 
justified to some extent by its success. 

We present the results of a numerical evolution of the function r), choos- 
ing the simplest observable O = exp{iz) and the parameter Nj = 0.1. To do this, 
both the evolution of the probability density P (see Eq. ([6])) and the evolution 
of the observable (see Eqs. (12T1) . (l24l) ) are needed. 

P{x,y;t — r) is obtained by using the time dependent FPE in the Fourier 
representation; a simple Euler discretization in time with time step 10~^ turns 
out to be sufficient. This was discussed already in some detail in [T9] . 

0{x + iy; r) is obtained as described in the previous section (Eqs. (12T|) . (!24|) ) 
by using the evolution of O under L or equivalently under Ly^. This evolution 
does not depend on either Nj or the cutoff Y, since neither L nor Ly^ depend on 
those two parameters. 

F{t,T) is then obtained by summing up the products of 0{x + iy;t) and 
P{x, y;t — t). The results are presented in Figs. [H [21 [31 IH 

In these plots we show F{t, r) as a function of r, for a number of t values, 
ranging from t = 1 to t = 7. For every t value, r runs from to t. In all cases 
Nj = 0.1, while the cutoff Y varies from Y = 3.162 in Fig. 1 to F = 0.158 in 
Fig. 3. 

The following features can be seen from the figures: 

(1) In general F{t, r) is not independent of r, 

(2) the dependence is always strongest at r = 0, 

(3) the sign of the r derivative changes somewhere between Y = 0.474 and 
Y = 1.582; there seems to be a 'best choice' of cutoff at which the derivative 
vanishes. 

This picture is corroborated by Fig. [5l which shows directly the r derivatives 
obtained as finite difference approximations. In this figure we also show different 
values of Nj and it is clearly visible that for very small values of Nj the derivative 
also effectively vanishes. Note that Ni = 0, which should be preferred for a CLE 
simulation, cannot be used for the FPE computations, because it would lead to 
instabilities (see Section VIB below). 

4.2 Mathematical analysis of the failure 

In this subsection we analyze in more detail the behavior of the time evolved 
observables in order to understand why in general F{t, r) is not independent of 
r. 

We describe the evolution of the observables in some more detail: the Langevin 
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operator L is 

L = -— — a sm(z — ic) — . (49) 
dz'^ dz 

For the observables e^^^ we find 

l^ikz ^ _p^ikz _ «^ (eCgi(/=+i). _ g-cgi(fe-i).^ ^ ^5Q^ 

Choosing now c = and a = /3, we consider an observable 

(9(^) = 5^afce*'=^ (51) 

and its time evolution 0{z] t) = ak{t)e'^^^ defined by Eq. fl2Tl) . This evolution 
can be expressed in terms of the coefficients as follows: 

dtakit) = -k^Ukit) + ^ [-{k - l)afe_i(t) + {k + l)afc+i(t)] (52) 

and may be viewed as evolution under L, L or, if we fix y = 0, as evolution 
under Lq. The evolution operator Lq in Fourier space is thus represented by a 
tridiagonal matrix with elements 

(Lo) = -k''5kk' + ^ [-{k - l)5k-i,k' + {k + l)4+i,fc'] . (53) 

V / kk' Z 

We now establish the following facts: 

(1) The Langevin operators Ly^ generate exponentially bounded semigroups on 
the Hilbert space L'^{dx) for any yQ. In particular there are no poles. 

(2) If the Fourier transform of O contains only positive modes, this will also be 
true for exp{tLyf^)0. But typically then all positive modes will be populated. 

(3) 

lim e*^«'C = — [ dxO{x + i?/o)e"^^'^+^^°^ (54) 

Zyo J 

and the convergence is exponentially fast. 

(4) For holomorphic observables O 

exp{tL)0 = exp{tLy^^)0 . (55) 

Since the right hand side is independent of Nj = iV^ — 1, so is the left hand side. 
This argument does not involve any integration by parts. 

(5) 0{x + iy; t) grows for t > more strongly than any exponential as ?/ — )■ oo, 
invalidating integration by parts except for Nj = 0. 
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The proof of (1) follows from a theorem to be found in [25] (Theorem 11.4.5). 
The point is that the drift (first order in derivatives) term of Ly^ is a so-called 
Phillips perturbation of the Laplacian: 

Ly, = A + B, (56) 

with ^ 

A = ^, i? = /3sin(x + 2|/o)^. (57) 

B can be applied to any vector of the form exp(ty4)'?/;, t > and we have 



dt\\B e^Y>{tA)\\ < oo . (58) 

These two properties allow to set up a perturbation expansion for exp[t(A + B)] 
and show its convergence. Explicitly 



oo „ 

^t[A+B) ^^tA^J2 e*^^5e(*^-*i)^5 . . . 5e(*-*")^ . (59) 

J0<ti<...<tn<t 



Convergence in norm is not hard to see: by Fourier transformation one sees that 

|l-^e*^|| = sup Ike-^^'l < , (60) 



hence 

||5e*"^ II < const /JelJ'"!^. (61) 

From this is it obvious that the bound (158|) holds; since the integration volume 
in Eq. ( 158|) is the series converges in norm; 

(2) is obvious; 

(3) means in particular that the evolution of O converges to a constant. While 
it is obvious that all constants are eigenfunctions of Ly^, we don't have sufficient 
analytic understanding of the spectra of the operators L^^, to prove this conver- 
gence. Numerically, however, it is seen easily that the evolution converges to the 
correct constant and the convergence is exponentially fast; 

(4) is an obvious consequence of analyticity; 

(5) is seen by numerically analyzing the growth of the coefficients ak(t) for 
t > 0: 

Using the initial condition ai = 1, = for k ^ and /3 = 1 as before, ak{t) 
are the Fourier coefficients of exp{tLo)Oi with Oi{x) = exp(zx). In Fig. refgrowth 
we plot — ln(|afc(t)|)/A; for four different times {t = 0.5, 1,2,3) against ln(A;). As 
remarked, only positive modes get populated; it turns out that the coefficients 
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ak{t) alternate in sign. From this we conclude that t) \ grows most for large 

negative y and is maximal for x = ivr. Modes were cut off at \k\ = 50, but the 
picture shows for all the times clearly an asymptotic linear increase with a slope 
close to 1, so we conclude 

ak{t) ^K'^ k-^", (62) 

with 7 possibly slightly less than 1 and some constant K. Further numerical 
studies show that the behavior of Eq. ( 162|) is universal: it is independent of the 
initial condition and f3. For comparison in this figure we also show (in black) the 
quantity \n{k\)/k + ln(2), which seems to be approached asymptotically by the 
other curves. 

Since Eq. fl62|) obviously implies 

|afc(t)| >rt-\ (63) 

by a simple argument we can conclude that 0{x + iy; t) grows superexponentially 
in y direction: we put w = e^; then, using only positive modes for the initial 
conditions, 0{z; t) is given by the power series 

oo 

0{z;t) = Y,ak{t)w{z)''. (64) 

fe=0 

Cauchy's estimate says that for any R> 

\ak{t)\ < S{R)R-'' , (65) 

where 

S{R)= sup \0{z{w);t)\= sup \0{x-i\nR;t)\. (66) 

\w\=R X 

From this and our numerics we conclude that asymptotically 

S{R) > {KRfk"^ (67) 
and this holds for any k. The optimal value is 

ko = {KR)e-^ , (68) 

which leads to the bound 

S{e-y) = \0{7T + iy)\> exp [const exp(-y)] . (69) 

Note that this holds in particular for y < 0\ Since for Nj > and t,r > one 
can at best expect a Gaussian decay of P{x,y;t), Eq. fl25|) in this case involves 
an integral of a function that is not absolutely integrable and hence its value is 
ambiguous, depending on the order of integrations. Thus the formal argument 
for correctness of the CLE fails. 
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5 FallofF of equilibrium measures 



In this section we study the t — )■ oo hmit of P{x, y; t), i.e. the equihbrium measure 
in order to check why and how our general criterion Eq. ( l33l) can fail. As remarked 
in Section [3l the equilibrium condition 

L^P(x,y;oo) = (70) 

implies fulfillment of the criterion 

Eo = j P{x,y]oo)LO{x + iy;0)dxdy = 0, (71) 

provided integration by parts on A^c without boundary terms at imaginary in- 
finity is justified. So the falloff of P{x, y; oo) is crucial for success or failure. 



5.1 U(l) one-link model 

For the U(l) one-link model studied in [9l[19] we are able to make rather precise 
statements about the falloff of the equilibrium measure in the y direction. 

The system is symmetric under the reflections x i— ?■ —x and y — c ^ —{y — c). 
To study the falloff of the equilibrium measure in y we again chose c = and 
grouped the data obtained by the CLE simulation into bins \y\ G [(n — l/2)e, {n + 
l/2)e) with e = 0.1. For clarity we chose rather large values of Nj = 0.1, 0.5, 1.0 
and 9.0. The results are shown in Fig. Hand show clearly a universal decay rate 

P(x,|/;oo)~exp(-2|y|). (72) 

This result improves considerably the statement made in [19] and also explains 
the difficulties with determining reliably expectation values of exp{ikz) for |/c| > 2 
(they are suffering from extremely large fluctuations). 

In |T9] we considered the Fourier modes 

Pk{y;t) = J dxe'^'^Pix^y-t)- (73) 
formally the expectation values of the exponentials are given by 

{e^'^) = I dyP,{y;t)e-'y, (74) 

using the fact that 

J dyPk{y;t) = J dxdy P{x,y;t) = 1. (75) 
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We simplify the notation for Pfc(?/; oo) to Pk{y)- By binning in y as above we 
also produced estimates of the modes Pk{y) for /c = 1, 2 and Nj = 1, shown in 
Fig. m P2 seems already to be quite noisy, but at least the first few kinks visible 
in the figure for P2 correspond to true sign changes. But what is more important 
is the clearly visible fact that Pi and P2 decay at least like exp(— 3|?/|). This 
can be confirmed using the stationary Fokker-Planck equation (FPE) obeyed by 
P{x, y; 00). In terms of the Fourier modes the FPE reads (see Eq. (65) of [T9]): 



{Nne - Njdl)Pk{y)+ ^ cosh(y) \{k - l)P,_i(y) - [k + l)Pfc+i(y) 

-^sm\i{y)dy[Pk-i{y) + Pk+i{y)\ =0. (76) 

Since we are interested in the large \y\ asymptotics, we may replace cosh(?/) 
and sinh(?/) by ±1/2 exp(|?/|). Integrating Eq. (!76|) for /c = from to ?/ and 
using evenness in y we obtain 

NiPi{y) + ^e\y\Pi{y) = Q. (77) 

So if Pq decays like exp(— 2|?/|), Pi will decay like exp(— 3||/|). Continuing induc- 
tively and assuming exponential decay, one obtains easily 

Pk{y) ~ Cfce-(l^'l+2)l^l . (78) 

Unfortunately Eq. fl76|) also implies that c^+i ~ kck-, which means that one cannot 
sum up the asymptotic behavior of the Pk to obtain the aymptotics of P{x, y; 00). 

More important is what we learn about the expectation values of exp{ikz), 
which should be given by 

(e-)^/p(.,.;^)e--..... ,79) 

The integral on the right hand side does not converge absolutely for \k\ > 2, hence 
its value is ambiguous. A well defined result may be obtained by first integrating 
over X, but it is not clear if this corresponds to the long time average of the 
complex Langevin process. But it seems that the large fluctuations observed in 
the CLE data reflect the fact that the integral is ill defined. 

One can also try to compute expectation values using the binning employed 
above. This corresponds to first integrating over x, then over y. The results, 
however, agree with those obtained directly by the CLE simulation (up to some 
loss of precision due to the finite width of the bins) and not to the exact values. 
This is of course no surprise, as the binning is based on the CLE simulation. 

The conclusion is that the CLE process with complex noise and without a 
field cutoff will in general not produce unambiguous results for the expectation 
values of exponentials exp{ikz) with higher \k\. 
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5.2 The model of Guralnik and Pehlevan 



To see if this phenomenon of slow decay of the equihbrium distribution is not 
just a speciahy of our U(l) one-hnk model, we also analyzed the equilibrium 
measure for the simplest polynomial model (called GP model in the sequel), 
studied already by Guralnik and Pehlevan [20] and discussed briefly in |19j . 

The model is defined by the action 

S = -tf3(^z + y'^ ; (80) 

since this action is purely imaginary, we have to deform the real axis to a path 
(submanifold) A^^ as described in Section II such that exp(— S') is absolutely 
integrable over Air- A possible choice (cf. [20]) is the path z = x + ^e^/l + x"^ for 
some small positive e. 

Since the action produces a stable fixed point at x = 0, ?/ = 1, we produced 
histograms representing P(x, ?/;oo) by binning r = ^yx^~+lJJ'^^^^Ty in intervals 
of length 0.1. They are shown in Fig. [91 Since in this case we expect a power 
falloff, we use a log- log scale. The indications are again that the rate of falloff 
is the same for different values of Nj > 0, namely roughly like r~^'^, whereas for 

= we find a stronger falloff (we cannot decide at this point whether it is 
still power-like or stronger). 

Accepting this observation one concludes that for Nj > again the higher 
moments {z'') of the equilibrium distribution are ill-defined, a fact that is reflected 
by large fluctuations of these quantities in the CLE simulations |19j . 

6 Testing the criterion 

We now proceed to test the truncated version of our criterion on the two toy 
models introduced; our primary interest is to see whether checking it only for a 
few low moments (modes) is sufficient to identify incorrect results. 

6.1 U(l) one-link model 

For this model we considered the two cases 

(3 = 1, K = (81) 

and 

/3 = 1, n = 0.25, /i = 0.5 (82) 
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(which is equivalent to /3 ~ 1.27, k = 0). In both cases we chose Nj = 0.1 which 
was found in [19] to lead to manifestly incorrect results for the CLE simulation 
without cutoff. Using the FPE as well as the CLE simulations, we measured 
the expectation values (exp(zz)) and (exp(2zz)) as well as the corresponding 
quantities {Lexp{iz)) and (Lexp(2zz)). Again we introduced a periodic cutoff 
Y in imaginary direction which stabilizes the FPE solution as well as the CLE 
expectation values. 

In Figs. [10] and [11] we show {Ok) divided by its exact value minus 1 and E^, 
both for k = 1, 2, 3. The results indicate the remarkable fact that at a particular 
value of the cutoff not only all the indicators 

Ek = {Lexp{ikz)) (83) 

vanish but also 

Cfc = {Ok) = {expiikz)) (84) 

agree with their exact values (it should be noted that due to the symmetry of 
the system the observables exp(— i^) and exp{—2iz) do not contain any extra 
information). Note that E2 has a second zero, but at that point Ei ^ 0. 

So in this case our simple test of the identity f[33l) for two observables is 
apparently sufficient to identify the correct simulation: it has sufficient sensitivity 
to reject wrong solutions. To make sure that at the properly tuned cutoff value the 
measure P is indeed correct, one would in principle have to check all exponentials, 
again a practical impossibility. 

In our U(l) one-link model the SDE hierarchy amounts just to the well known 
recursion relation for the Bessel functions IkiP) and it is determined by fixing 
(1) = 1 and (exp(zz)) = ci. In a CLE simulation ci will depend on the value of 
the cutoff. If 

the SDE recursion rapidly runs away to infinity and it is manifest that the bound 
Eq. f[37]) cannot hold. So this bound seems to be crucial for picking out the right 
solution of the SDE. On the other hand the cutoff models in general obey the 
bound, but unless the cutoff is tuned correctly, they will miss the right value of 
Ci and fail to obey the SDE recursion. 



6.2 Guralnik-Pehlevan model 

We next apply our test to our other toy model, the cubic model of Guralnik 
and Pehlevan. Since this model has noncompact real and imaginary parts, we 
introduce two periodic cutoffs: X for the real and Y for the imaginary part. 
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In this model L = d1 + + z'^)dz, and the first few relations read 



E2 
^3 



E- 



1 



{LZ): 



if3{l + z^) 

-- 2{l + i/3z{l + z^)) 

--3{2z + i(3z\l + z^)) , 



(86) 



leading to SD relations between the expectation values of z''. 

It is easy to see that the exact results, which can be expressed in terms of Airy 
functions (see [20]) and for /3 = 1 are (z) ^ 1.1763i, {z'^) = -1, {z^) ^ -0.1763i, 
indeed satisfy these relations. 

We measured the moments Ck = {z^) for k = 1,2,3,4; this allows also to 
obtain E2 = {Lz'^) and E3 = {Lz^); note that Ei = (Lz) = i + i{z'^) = is 
already tested by comparing (z^) to its exact values —1. In Fig. [12] we present 
the results obtained for Nj = 1 and a fixed cutoff X = 3.17 in x direction, both 
by using the FPE and the CLE simulation. For this value of Nj it was observed 
already in [19] that CLE without cutoff does not reproduce the correct values. 
The figure, on the other hand, shows that there is a value of the y cutoff (near 
Y = 0.8) for which the two criteria E2 = E^ = are fulfilled and also the right 
values for the moments Ci, C2, C3, C4 are obtained. 

With purely real noise {Nj = 0) the situation is quite different. For this case 
the FPE simulation is unstable: Fig. [13] shows the time evolution of the FPE 
for Nj = 0; the evolution settles onto metastable values very close to the exact 
ones, but then takes off and diverges. For comparison we also show the FPE 
time evolutions for two rather small nonzero values: Nj = 0.01 and Nj = 0.1 
(all three figures are using the cutoffs X = Y ^ 3.95). As seen in Figs. [131 [IH 
the small imaginary noise is sufficient to stabilize the evolution, at least for the 
times considered. This seems to conform at least qualitatively to the discussion 
found in Numerical Recipes Ch. 19 [26]. Quantitatively from that discussion one 
would expect that much larger values Nj would be needed for stabilization; we 
are lucky that this does not seem to be the case here and in fact with this small 
nonzero Nj we obtain good convergence to the exact result, provided the cutoff 
is not extremely small. 

The CLE simulation, on the other hand, works perfectly for Nj = 0. We have 
seen already in Section [3] that for Nj = the equilibrium distribution is quite 
well concentrated and shows a very strong falloff. In agreement with this, we 
find that the data are quite insensitive to the cutoffs introduced; for X = 3.95 
as before, even a cutoff of Y = 0.8 is sufficient to produce values close to the 
exact ones and consequently also fulfill the criteria Ei = E2 = E^ = with good 
precision. These facts can be clearly seen in Fig. [TJl in this figure we display for 
comparison the CLE results for Nj = and the FPE results for Nj = 0.01 (recall 
that Nj = does not allow for a viable FPE solution). 
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Again we found that our simple test seems to have sufficient sensitivity to 
select the right simulation. 

7 Conclusions and outlook 

In this paper we have pinned down the reasons why the CLE simulations some- 
times fail to produce correct expectation values and we have developed practical 
tests for correctness. In two toy models we checked the strength of the test, by 
deforming the process through introduction of complex noise {Nj > 0) as well 
as cutoffs. It turned out that our tests are successful in picking out the correct 
results. 

In the context of this paper the introduction of a nonzero Nj plays a double 
role: 

(1) As a means to check the applicablity of the formal proofs for correctness of 
the CLE. 

(2) As a parameter which can be used for tuning and stabilizing the simulation. 
As such it is needed in FPE computations, but for true lattice models, where 
there is little chance to use the FPE anyway, it is probably still best to stay with 
Nj = 0. The periodic field cutoff introduced in the toy models should be seen in 
a similar way. 

One should not, however, expect that this simple device of tuning a cutoff 
will work in general to produce correct results. Other modifications might be 
necessary, but the most promising choice is still to work with the unmodified 
CLE process and purely real noise. 

The main point is that our results demonstrate the 'sensitivity' of the trun- 
cated test criterion, in addition to the 'specificity' which holds on general grounds. 

While we studied here only two very simple models, we believe the reasons 
for incorrect results identified here apply much more generally. They are: 

• rapid growth of the Langevin evolved observables in imaginary direction, 

• slow decay of the equilibrium distribution. 

The study of the issues discussed in this paper will be continued; both the eti- 
ology and the diagnostics will by studied in the XY model [21] and in nonabelian 
models [27] . 

Acknowledgments 

I.-O. S. thanks the MPI for Physics Miinchen and Swansea University for 
hospitality. G. A. and F. A. J. are supported by STFC. 



22 



References 



[1] 

[2] 

[3] 
[4] 
[5] 
[6] 

[7 



[9 
[10 

[11 

[12 
[13 

[14 

[15 
[16 

[17; 

[18 
[19 



P. de Forcrand, PoS LAT2009 (2009) 010. [ arXiv:1005.0539l [hep-lat]]. 

J. Klauder, Acta Phys. Austriaca Suppl. XXXV (1983) 251; J. Phys. A: 
Math. Gen. 16, L317-319 (1983); Phys. Rev. A 29, 2036-2047 (1984). 

G. Parisi, Phys. Lett. B 131 (1983) 393. 

F. Karsch and H. W. Wyld, Phys. Rev. Lett. 55 (1985) 2242. 

P. H. Damgaard and H. Hiiffel, Phys. Rept. 152 (1987) 227. 

J. Berges and L -0. Stamatescu, Phys. Rev. Lett. 95 (2005) 202003 
|hep-lat/0508030| . 

J. Berges, S. Borsanyi, D. Sexty and L O. Stamatescu, Phys. Rev. D 75 
(2007) 045007 | hep-lat/0609058 |. 

J. Berges and D. Sexty, Nucl. Phys. B 799 (2008) 306 [0708.0779 [hep-lat]]. 

G. Aarts and L-0. Stamatescu, JHEP 0809 (2008) 018 [0807.1597 [hep-lat]]. 

G. Aarts, Phys. Rev. Lett. 102 (2009) 131601 [0810.2089 [hep-lat]]. 

G. Aarts, F. A. James, E. Seller and I. O. Stamatescu, Phys. Lett. B 687 
(2010) 154 [ arXiv:0912.0617,. [hep-lat]]. 

G. Aarts, JHEP 0905 (2009) 052 [0902.4686 [hep-lat]]. 

G. Aarts and K. Splittorff, JHEP 1008 (2010) 017 [arXiv: 1006.03321 [hep- 
lat]]. 

G. Aarts and F. A. James, JHEP 1008 (2010) 020 [arXiv: 1005.34681 [hep- 
lat]]. 

J. Ambjorn and S. K. Yang, Phys. Lett. B 165, 140 (1985). 
J. R. Klauder and W. P. Petersen, J. Stat. Phys. 39 (1985) 53. 

H. Q. Lin and J. E. Hirsch, Phys. Rev. B 34 (1986) 1964. 

J. Ambjorn, M. Flensburg and C. Peterson, Nucl. Phys. B 275, 375 (1986). 

G. Aarts, E. Seller and I. O. Stamatescu, Phys. Rev. D 81 (2010) 054508 
|arXiv:0912.3"360i [hep-lat]]. 



[20] G. Guralnik and C. Pehlevan, Nucl. Phys. B 822, 349 (2009) 
|arXiv:0902. 15031 [hep-lat]]. 



23 



G. Aarts, F. James, E. Seller and I. O. Stamatescu, in preparation. 

M. Reed and B. Simon Functional Analysis vol. I, New York and London: 
Academic Press 1972. 

E. Seller, Untersuchung eines selbstgekoppelten relativistischen Skalarfeldes 
mit Funktionalmethoden, Doctoral thesis (Technische Universitat Miinchen 
1971), unpublished (in German). 

C. Pehlevan and G. Guralnik, Nucl. Phys. B 811, 519 (2009) 
[ arXiv:0710.3756 [hep-th]]. 

E. B. Davies, Linear Operators and their Spectra, Cambridge University 
Press, Cambridge, UK 2007. 

W. H. Press et al, "Numerical Recipes in Fortran 77 - The Art of Scientific 
Computing", Second Edition, Ch. 19, Cambridge University Press, Cam- 
bridge 1992. 

G. Aarts, F. James, E. Seller, D. Sexty and I. O. Stamatescu, in preparation. 



24 




25 




26 




Figure 3: As in Fig. 1, with Y = 0.474 
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Figure 4: As in Fig. 1, with Y = 0.158. 
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Figure 5: r derivative of F{t, r) as a function of r at t = 10 for several values of 
the cutoff Y and complex noise parameter Ni. 
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Figure 7: Logarithmic histograms of the equihbrium measures for the U(l) one- 
hnk modeL 
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Figure 8: Logarithmic histograms of the low modes of the equihbrium measures 
for the U(l) one-hnk modeL 
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Figure 10: Cutoff [Y) dependence of various quantities in tlie U(l) one-link 
model, for /3 = 1, k = 0, Nj = 0.1. See main text for further details. 
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beta=1 , kappa=0.25, mu=0.5, Nl=0.1 vs tanh(Y/1j581): 

FPE0(1)/ex-1 ---Q-- 
' CLE0(1)/ex-1 : ■ 
g 'FPE 0(2)/ex-1 « 
.■' FPE E(1) - B - 

.h',' CLE E(1) -•- 

..- / FPE E(2) - e - 



--a B— -□ 



0.2 0.4 0.6 0.8 



Figure 11: As in Fig. [TOl for /3 = 1, k = 0.25 and // = 0.5. 
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Figure 13: FPE evolution in the GP model: t dependence of various quantities 
for Nj = 0, (5 = 1 and cutoffs X = Y = 3.95. See main text for more details. 
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Figure 14: As in Fig. 13 for Nj = 0.1. 
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Figure 15: GP model: Cutoff (y) dependence for /3 = 1 and Nj = (CLE) and 
Ni = 0.01 (FPE) 



39 



